# Decoder-to-Encoder Conversion

LLM2Vec is a solution for converting decoder-only large language models into text encoders, achieved by enabling bidirectional attention, masked next-word prediction, and unsupervised contrastive learning.

LLM2Vec is a simple solution for converting decoder-only large language models into text encoders, achieved by enabling bidirectional attention mechanisms, masked next-token prediction, and unsupervised contrastive learning.